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20.  ABSTRACT  (Cmtimf  m  rmrN  It  vtMMMry  Ad  ItfMffO  Aloe*  numb*) 

-  Consider  a  situation  in  which  n  members  of  a  group  are 

asked  to  determine  whether  a  proposition  ii  true  or  false.  In 
the  simplest  case,  where  all  make  their  decisions  independently 
of  each  other,  a  straightforward  majority  rule  is  best  in  the 
sense  of  maximizing  the  probability  of  a  correct  group  decision. 
Where,  however,  there  is  a  substantial  degree  of  statistical  . 
dependence  among  the  group  members'  decisions,  other  rules  may  - 
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Guillermo  Owen 

Consider  a  situation  in  which  n  members  of  a  group  are  asked  to 
determine  whether  a  proposition  is  true  or  false.  We  shall  assume,  for 
Bayesian  purposes,  that  the  a  priori  probability  of  truth  or  falsehood  is 
1/2.  Moreover  we  assume  that  each  individual  has  a  probability  p  >  1/2 
of  giving  a  correct  answer  (and  that  this  p  is  the  same  for  all).  The 
question  is  whether  there  would  be  any  reason  to  use  other  than- a 
straightforward  majority  rule  for  this  purpose. 

As  an  example,  consider  the  case  n  *  5.  Straightforward  majority 
rule  means  that  the  group  will  accept  as  correct  the  opinion  of  any  three 
of  them. 

Suppose,  however,  that  three  of  the  members  show  a  strong  positive 
correlation  in  their  judgments;  the  other  two  decide  Independently.  In 
that  case.  It  is  not  too  difficult  to  see  that,  for  sufficiently  high 
correlation  among  the  first  three,  a  positive  3-2  vote  (pitting  the 
first  three  against  the  other  two)  should  not  give  rise  to  a  positive 
group  judgment;  In  fact  the  two  negative  votes  represent  two  negative  bits 
of  Information,  whereas  the  three  positive  votes  might  represent  as  little 
as  one  positive  bit. 


84760  -  0WEN/L1 11 Ian 


2 


The  above  decision  rule  Is,  of  course,  not  "fair":  the  three  first 
decision-makers  are  treated  worse  than  the  other  two.  Unless  there  Is 
reason  to  expect  this  type  of  behavior  on  the  part  of  the  group  members, 
this  decision  rule  might  be  open  to  serious  (e.g.,  constitutional) 
objections. 

There  are,  however,  "fair"  group  decision  rules  which  are  not  direct 
majority  rules.  ("Fair"  means.  In  mathematical  terms,  that  the  winning 
coalitions  allow  a  transitive  group  of  permutations  over  the  set  of  all 
Individual  voters.)  The  best  known  such  rule  would  be  the  Indirect 
majority  decision  rule:  the  group  of  n  members  Is  divided  Into  m 
subgroups  with  n/m  members  each;  each  subgroup  decides  by  majority  vote 
among  Its  n/m  members,  and  the  entire  group  decides  by  a  majority  of 
the  m  subgroups. 

Whether  such  a  rule  Is  more  efficient  (l.e.,  is  more  probably  correct) 
than  straightforward  majority  rule  will  depend  on  the  voting  correlations 
among  the  several  Individuals.  Let  us  therefore  consider  the  following 
model.  Each  of  the  m  subgroups  has  a  "Group  spirit"  (possibly  a  group 
leader)  which  makes  a  decision;  these  m  decisions  each  have  probability 
p  of  being  correct,  and  they  are  Independent.  Now  each  of  the  k  members 
of  the  jth  subgroup  will  either  (1)  with  probability  Oj,  follow 
his  leader,  or  (2)  with  probabllty  1  -  aj,  make  an  Independent 
decision,  which  also  has  probability  p  of  being  correct.  According  to 

this  model,  two  members  of  the  same  (j^)  subgroup  make  correlated 

2 

decisions,  with  correlation  ;  members  of  two  different  subgroups  act 
Independently.  Each  member  has  probability  p  of  being  right.  The  number 
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Oj  (0  <^Oj  <  1)  represents,  somehow,  the  "charisma"  of  the  group  leader, 
or  the  cohesiveness  of  the  group. 

In  this  model.  It  might  seem  that,  for  sufficiently  high  values  of  the 
ait  the  Indirect  majority,  rule  could  be  better  than  the  direct  majority 
rule.  In  fact,  however,  for  equal  values  of  a-  this  Is  usually  not 
so.  For,  as  an  example,  suppose  we  have  a  group  with  three  subgroups  (of 
equal  size).  Assume  subgroup  1  votes  80%  positive,  while  subgroups  2  and  3 
both  vote  60%  negative.  In  this  case,  the  groups  divide  2*1  negative, 
but  the  Individual  vote  Is  53%  positive.  It  turns  out  that  the  "most 
likely"  Interpretation  Is  that  the  common  value  of  the  o-'s  Is  near 

“  J 

0.4;  the  group  leaders  have  voted  2-1  negatively,  but  the  Independently 
voting  members  are  voting  positively,  2-1.  Thus  the  weight  of  the  evidence 
Is  positive. 

Let  us  suppose,  however,  that  the  cij  are  not  all  equal. 

"Fairness"  requires  that  the  several  subgroups  be  treated  equally,  but  we 
can  do  this  by  assuming  that  the  <Xj  are  drawn  Independently  from  an 
identical  distribution— perhaps  a  uniform  distribution  over  the  unit 
interval.  (The  Interpretation  Is  that  each  group  has  a  leader,  but  some 
leaders  turn  out  to  be  more  charismatic  than  others.)  In  this 
Interpretation,  the  heavy  positive  voting  In  subgroup  1  seems  to  mean  that 
Its  leader  Is  very  popular,  l.e.,  a-j  Is  very  high  while  cu»  and 
Oj  are  low. 

Let  us  see  how  this  works.  There  are  essentially  two  possibilities: 
the  proposition  Is  either  true  or  false. 
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(1)  The  proposition  Is  true.  Then  the  group  leader  for  subgroup  1  Is 

2 

right  and  the  other  two  are  wrong.  The  probability  of  this  Is  pq  . 
Assuming  n  Is  very  large,  the  fraction  Sj  of  members  of  group  1 
voting  positively  Is 

s1  «  +  pd-o^)  »  ajq  +  p 

(where  q  *  1-p)  while  the  fractions  S2  and  S3  voting  positively 
will  be 

Sj*  (l-a^P  (j  -  2,3). 

This  gives  us  densities  1/q  for  Sj,  and  1/p  for  S2  and  S3,  all 
Independent.  The  joint  density  of  (Sj^^)  then  Is 
pq2/qp2  *  q/p  <  1. 

(2)  The  proposition  Is  false.  Similar  reasoning  tells  us  that  the 
joint  density  Is  p/q  >  1. 

Assuming  a  uniform  Bayesian  prior,  then,  the  posterior  distribution 

2 

assigns  probability  to  case  (2):  the  proposition  Is  false.  This 

p  +  q 

is  greater  than  1/2  (since  p  >  q) ;  thus  the  indirect  majority  rule 
gives  a  better  result  than  the  direct  majority  rule. 

More  generally,  suppose  we  have  a  division  of  a  group  Into  subgroups. 
Instead  of  an  "Indirect  majority  rule"  such  as  described  above,  we  might 
consider  as  rule  which  assigns  a  certain  number  of  points,  either  positive 
or  negative,  to  the  result  within  each  group,  depending  on  the  number  of 
positive  and  negative  votes  within  the  group.  In  other  words,  we  would 
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"j  *  9j(nj»kj) 

where  Is  the  number  of  Indldvlduals  In  subgroup  j,  and  kj  the 
number  of  these  voting  affirmatively  In  that  subgroup.  Then  the  whole 
group  will  accept  the  proposition  If 


m 

W  *  j  w 

j-1  J 

Is  positive,  and  reject  If  U  <  0. 

The  slmpllest  case,  of  course.  Is  given  by  w^.  *  2k^  ■  Oj:  it 
corresponds  to  direct  majority  rule.  The  Indirect  majority  rule  is  given 
by 


9j<Vkj>  ' 


1 

-1 

0 


if  2kj  >  n 

2kj  <n 

2kj-n 


j 

j 

j  * 


Other  rules  may  however  be  used:  we  would  expect  simply  that  g^ 
be  monotone  as  a  function  of  k^  for  each  nj,  and  (for  symmetry)  that 

9JtnJ*kJ)  '  '9 j(V4‘kJ)  • 

ni 

We  might  also  ask  that  gj  be  concave  in  k^  for  k^  >jJ-  , 
although  that  is  not  strictly  necessary. 

It  remains  to  see  how  the  rules  gj  should  be  chosen. 

To  see  how  this  can  be  done,  let  us  assume  that.  In  a  given  subgroup 
each  Individual  has  probability  p  of  a  correct  vote,  and  that  the  voting 
correlations  among  the  several  Individuals  are  maintained  constant.  In 
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that  case,  a  given  configuration.  A,  of  correct  votes  has  a  probability 
H^(p),  and  the  complementary  configuration  has  probability  HA(l-p) 
of  occurring.  The  conditional  probability  that  a  positive  vote  Is 
correct,  given  that  the  configuration  A  voted  positive.  Is  then 

ha(p) 

P(P0SIA)  ■  Ha(p)  7  HA(l-p) 


and  clearly,  the  probability  that  a  negative  vote  Is  correct  woud  then  be 

HAC1-P) 

p("eglA)  ■  ha(p)'  +  HAn-p7 


The  weight  to  be  given  to  such  a  configuration  Is  then 


or  consequently 

cw(A)  »  log  «A(p)  -  log  HA(l-p)  , 


where  c  Is  a  constant  of  proportionality. 

Suppose,  now,  that  p  Is  slightly  greater  than  1/2:  p  *  1/2  +  r, 
where  r  Is  small.  These  are  generally  the  interesting  cases,  as  they 
represent  situations  where  opinion  will  likely  be  closely  divided.  We 
have  then 

cw(A)  «  log  Ha(^+  r)  -  log  HA(y  -  r) 
or 

cwfAl  .  ZHA<?> 

r  u 


\  v  \ \  v  **  v  v»  »»  V  vv  ‘  *  v  V S  V  V ' 


84760  -  0WEN/L1 11 Ian 


so  that  w(A)  should  be  chosen  proportional  to  ha(*j)/Ha(^).  To 
determine  the  constant  of  proportionality  we  note  that,  If  the  subgroup 
reduces  to  a  single  Individual,  there  Is  only  one  possible  configuration, 
and  we  will  have 


H(p)  *  p  :  H • (p)  *  1 

so  that 

H(*r)  j 

Hence,  if  we  assign  weight  1  to  a  single  positive 
assign  weight 


w(A) 


1  ha<?> 

2  ha<?> 


e,  we  should 


to  a  positive  vote  by  the  subset  A,  with  negative  votes  by  the 
complementary  subset. 

Suppose,  now,  that  a  group  with  N  Individuals  Is  divided  into  m 
subgroups,  with  n^,n2«  ...»  nm  Individuals  respectively.  We  assume  once 
again  that  all  Individuals  have  equal  probability  p  of  voting  correctly. 

Suppose  that  In  a  given  subgroup,  with  n  members,  k  of  them  vote 
affirmatively,  while  the  remaining  n-k  vote  negatively.  Assuming  an 
Index  o  of  correlation  (as  discussed  above),  the  probability  that 
exactly  the  given  k  vote  correctly  is 


h(p;o)  -  p(<*ep)k  (Bq)n’k  +  q(Bp)k  (o*0q)n‘k 
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where  q  *  1-p,  8  *  1-a.  This  can  be  rewritten  as 

h(pia)  ■  pqn”k  (p  +  qa)k  (l-o)n"k  +  qpk  (l-a)k  (q  +  pa)n“k. 

If  a  Is  known  this  can  be  evaluated  directly,  as  can  Its 
derivative.  Suppose,  however,  that  a  Is  assumed  distributed  according 
to  the  density  function  f(a).  0  <  1.  Then  we  would  set 

H(p)  -  I  h(p; a)  f(a)  da 

Jo 

and  this  may  or  may  not  be  easy  to  evaluate,  depending  on  the  form  of  f. 
We  will  consider  here  the  one-parameter  family  of  distributions 

f (a)  -  (v+1)(l-a)V  0  <  a  <  1 

where  v  >  -1  Is  a  parameter.  We  would  then  have 

H(p)  -  (v+1)  pq"-k  f  (p+qo)k  (l-o)"*k+v  do 

Jo 

+  (v+1)  qpk  f  (l-a)k+V  (q+pa)n“k  da  . 

■'0 

The  change  of  variables  u  *  p  +  qa  transforms  this  to 

H(p)  -  (v+1)  pq-v-’  f’  uk(l-u)n-k+#  du 

J  P 

+  (v+1)  qp-v-'  f'  (l-u)k+v  un-k  du  . 

•'q 
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Some  calculus  will  now  give  us 

h-(p)  *  f1  <ik(i-u)n-k+w  iu 

q  •'P 

-  tv+W1)  f  (1-u)k+v  u"-k  du 

q  ■'q 

k+1  „n-k-l  ,  k-1  _n-k+l 

-  P  q  +  P  q 

Evaluating  at  p  *  1/2,  we  will  have 

H(j)  .  (v+1 )2V  f  [uk(l-u)n‘k+v  +  (l-u)k+v  u"'k]  du 

2 

and 

'  H'(I)  =  (v+l)(V2)2V+1  j’  [Uk(l-U)"-k+v  -  (1-U)k+V  u"-k]  du 

1 

The  desired  weighting  factor  would  then  be 
H'(?) 

w  = - , — 

2H(^) 

or 


Students  of  probability  will  of  course  recognize  the  Integrals  In  this 
last  expression  as  the  Incomplete  beta  function,  defined  as 
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our  expression  is  then 

Bi/gtn-k+v+l.k+l)  -  By2(k+v+1»n”k+1) 
w  “  (v+2)  B1/2(n-k*v+l,kil)  +  81/2(k+v*l,n-i;5T) 

Unfortunately,  the  Incomplete  beta  function  Is  not  extensively 
tabulated.  For  small  values  of  n,  it  is  of  course  possible  to  evaluate 
the  integrals  directly  (analytically)  as  the  Integrands  reduce  to 
polynomials  of  degree  n.  For  large  values  of  n,  the  integrals  must  be 
evaluated  numerically,  though  certain  approximations,  related  to  the  normal 
distribution  function  are  also  available  [Abramowitz  &  Segun,  1964], 

It  is  not  too  difficult  to  see  that,  if  k  is  considerably  larger 
than  n/2,  then  w  will  approach  v+2  asymptotically;  clearly  w  ^v+2 
at  all  times.  We  note  that  the  parameter  v.  can  be  taken  as.  In  some 
sense,  a  measure  of  the  subgroup's  a  priori  independence:  large  values  of 
v  mean  that  a  will  tend  to  be  small,  and  vice-versa.  Thus  If  v  Is 
large,  a  large  margin  for  one  or  the  other  possibilities  Is  given 
relatively  heavy  weight— coming  as  it  does  from  individuals  who  tend  to 
choose  independently. 

As  an  example,  consider  the  case  of  a  group  divided  into  subgroups  of 
15  individuals  each.  The  Table  1,  shows  values  of  the  functions 

Wj  »  g(15,k  ;  v) 

for  8  <  k  <  15  and  v  »  0,1,2.  As  may  be  seen,  for  v  *  2,  an  8-7 
margin  should  be  weighed  0.6,  while  a  9-6  margin  is  weighed  1.7  —not 
quite  three  times  as  much  as  an  8-7  edge.  As  k  Incre^s  to  15,  the 
weight  approaches,  but  never  quite  reaches,  the  limiting  value  v+2  *  4. 
Similar  considerations  may  be  seen  throughout  the  table. 
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TABLE  1 


n  *  15 


k 

v  ■  0 

v  *  1 

v  *  2 

8 

0.393 

0.514 

0.604 

9 

1.091 

1.457 

1.738 

10 

1.580 

2.183 

2.672 

11 

1.846 

2.642 

3.332 

12 

1.957 

2.875 

3.722 

13 

1.992 

2.967 

3.908 

14 

1.999 

2.994 

3.977 

15 


2.000 


2.999 


3.996 
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